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query texture descriptor including texture feature values and 
rotation Information is extracted; aligning the rotating angle 
between the query texture descriptor and the texture 
descriptor according to the rotation information; and 
determining the similarity between the images dependent 
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TEXTURE DESCRIPTION METHOD AND TEXTURE-BASED 
RETRIEVAL ME 1 1 IOD IN FREQUENCY DOMAIN 

TECHNICAL FIELD 

5 The present invention relates to a texture description method for an image, 

and more particularly, tp a method of describing image texture in the frequency domain, in 
which image signals are converted into those in a frequency domain of the Polar coordinate 
system to extract texture features. Also described herein is a method of texture-based 
retrieval of images indexed by the texture description method. 

10 BACKGROUND OF THE INVENTION 

The texture informatibn of an image is one of the most important visual 
characteristics of the image and thus, has been studied together with the color information 
for a substantial period of time. This texture information of the image is usually used as an 
important low-level visual descriptor in content-based indexing and in abstracting an image 
or video data. Also, image texture is very important information used for retrieval of a 
special picture in an electronic album or content-based retrieval in tiles or textiles database. 

Until now, feature values have generally been computed in the lime domain 
or in the frequency domain to extract a texture feature of the image. More particularly, the 
method of extracting the texture features in the frequency domain was known to be suitable 
for describing image texture information of various types. Extracting texture features in 
the frequency domain can be done in the Cartesian or the Polar coordinate system. 

Conventionally, the Cartesian coordinate system has been widely used in 
extracting a texture feature in the frequency domain. 

A paper entitled "Texture Features For Browsing And Retrieval Of Image 
Data", written by B.S. Manjunath and W.Y. Ma is published in "IEEE Transaction on 
Pattern Analysis and Machine Intelligence", vol.18, no.8, in August of 1996, addresses a 
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method of dividing the frequency domain of the Cartesian coordinate system based on 
MVS (Human Visual System) filtering of an image in the respective channels by Gabor 
filters, and then extracting the average and the standard deviation from the respective 
channels as texture features of the image. 

5 However, the method of describing image texture is not suitable in the 

frequency domain of the Cartesian coordinate system for the HVS and leads to poor 
performance in relevant texture images. 

To solve the problem of the image texture description method in frequency 
domain of the Cartesian coordinate system, a paper on image texture description method in 

10 frequency domain of the Polar coordinate system was published, in which the texture 
information in the frequency domain is computed in the Cartesian coordinate system. 

In the paper entitled "Rotation-invariant Texture Classification using a 
complete Space Frequency Model", written by B.S. Manjunath and Geoge M. Haley and 
published in "IEEE Transaction on Pattern Analysis and Machine Intelligence", vol. 8, 

15 no.2, in February of 1999, a method of dividing a frequency space of the Polar coordinate 
system based on HVS (Human Visual System), then extracting 9 feature values using a 
Gabor filter designed to be suitable for respective channels, and describing the image 
texture using the extracted feature values of all channels was disclosed. 

However, in this method, the same design of a set of Gabor filters is used 

20 for extracting different kinds of texture features in the frequency domain. . 

SUMMARY OF THE INVENTION 

The present invention provides a method of retrieving relevant data images 
similar to a query image in a frequency domain according to claim 1 . 

25 

It is preferable that the step of extracting said texture descriptor in said first 
and second steps (of claim 1 ) includes a first sub-step of generating a frequency' layout by 
partitioning the frequency domain into a set of feature channels so as to extract respective 
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feature value; a second sub-step of extracting texture feature values of said images in said 
respective divided frequency domains; and a third sub-step of constituting a texture 
descriptor of said image in a vector form by using said feature values extracted in said 
respective frequency channels of said frequency layout. 
S ft is more preferable that said step of extracting said rotation information of 

said images in said first and second steps include a first sub-step of finding out a direction 
in which energy is much distributed in the Fourier transform of said inputted image; a 
second sub-step of generating a frequency layout by using said direction as a reference 
axis; and a third sub-step of adding said rotation information of said frequency layout to 

1 0 said texture descriptor of said image. 

It is still more preferable that said first sub-step in said step of extracting 
said texture descriptor includes a step of generating at least one frequency layout in 
consideration of HVS; and a step of giving significance or priority to respective feature 
channels of sail! frequency layouts. 

15 Preferably, said second sub-step in said step of extracting said texture 

descriptor includes a step of Radon-transforming said inputted image; a step of Fourier- 
transforming said Radon-transformed image; and a step of extracting said texture feature 
values from said Fourier-transformed image with respect to said respective frequency 
layout, and it is preferable that the step of extracting texture feature values from said 

20 Fourier-transformed image is of extracting at least energy values or energy deviation values 
in said respective feature channels. 

The present invention also provides a computer readable recording medium 
according to claim 7. 

25 Also described herein is a texture description method in a frequency 

domain, suitable for HVS, in which image texture features are computed and indexed in a 
frequency domain. 

Also described herein is a texture-based retrieval method by using texture 
features computed in the frequency domain of the Polar coordinate system, in which 
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similar images in different variations, such as different rotations or scales or pixel intensity, 
are retrieved by comparing a query texture descriptor with a data texture descriptor 
generated by the texture description method and taking into account such variations 
thereof. 

S Also described herein is a texture description method in the frequency 

domain of the Polar coordinate system that includes a first step of generating a frequency 
layout by partitioning said frequency domain into a set of feature channels; a second step of 
extracting texture feature values of said image from said respective feature channels; and a 
third step of constituting a texture descriptor in a vector form by using said texture feature 
10 values extracted from said respective feature channels in said frequency layout. 

It is preferable that said first step is of generating said frequency layout on 
the basis of the HVS (Human Visual System), and that said frequency domain in said first 
step is that of the Cartesian coordinate system or the Polar coordinate system. 

It is also preferable that said first step includes a sub-step of generating 
15 different frequency layouts for different types of texture features, that is, each texture 
feature type for its respective frequency layout. 

It is further preferable that said first step comprises a sub-step of assigning 

signi ficance or priority to the respective channels. 

Also, it is preferable that said second step include a first sub-step of Radon- 

20 transforming said image; a second sub-step of Fourier-transforming said Radon- 
transformed image; and a third sub-step of extracting said texture feature values of said 
Fourier-transformed image from said respective feature channels. 

It is further preferable that said third sub-step is of extracting at least energy 
deviation values and/or energy values in said respective feature channels. 

25 Here, it is preferable that a frequency layout for obtaining said energy 

values and a frequency layout for obtaining said energy deviation value is separately 
prepared for extracting different types of an image texture, and that said frequency layout 
for obtaining said energy values partitions said frequency domain at intervals of 2' (0 < / < 
| 0g2 (N/2)-l) on an octave scale in a radial direction and at intervals of '180/dividing 
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resolution' degrees in an angular direction. The frequency layout for obtaining said energy 
deviation values partitions said frequency domain at the same intervals in a radial direction 
and at intervals of 4 180/dividing resolution' in an angular direction. 

It is preferable that said third step is of finding out a rotational reference axis 
5 of said image by using said image texture information, rotating said frequency layout with 
reference to said rotational reference axis, and then extracting said image texture descriptor 
of said image. Here, the rotational reference axis is set to be an axis in a radial direction, in 
which one of energy, entropy, and a periodical component is most distributed by Radon- 
transforming said image. 

10 Preferably, the third step is of Fourier-transforming said image to find out a 

radial reference point, normalizing said Fourier-transformed image with reference to said 
reference point, and then describing said texture descriptor by using said normalized values 
of said Fourier-transformed image. Here, the radial reference point is set by determining 
1 an arc in which one of energy, entropy, and a periodical component of said Fourier- 

15 transformed image apart at the same distance from the origin in said frequency domain is 
most distributed, and then setting a radius of said founded arc as said radial reference point. 

It is preferable that the method of describing image texture in a frequency 
domain further comprise a fourth step of extracting intensity information of said image to 
add said intensity information to said texture descriptor. 

20 Also described herein is a computer readable recording media recording a 

program for realizing a texture description method in a frequency domain is provided. The 
program performs a first step of generating a frequency layout by partitioning said 
frequency domain into a set of feature channels; a second step of extracting texture feature 
values of said image by Radon-transforming said image in said respective feature channels, 

25 Fourier transforming said Radon-transformed image, and extracting texture feature values 
of said Fourier-transformed image from respective feature channels; and a third step of 
constituting a texture descriptor of said image in vector form by using said texture feature 
values extracted from said respective feature channels. 
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Also described herein is a meihod of populating a database wilh texture 
descriptors of images. The method includes a first step of generating a frequency layout by 
partitioning the. frequency domain into a set of feature channels: a second step of extracting 
icxture feature values of said images in said respective feature channels; a third step of 
5 constituting texture descriptors of said images in vector forms by using said texture feature 
values extracted in said respective feature channels of said frequency layout; and a fourth 
step of indexing said respective texture descriptors of said images into said database. The 
first step comprises a first sub-step of generating the respective frequency layouts for 
texture feature types by partitioning the frequency domain into the respective sets of 
10 feature channels; and a second sub-step of extracting said texture feature values of each 
type for said images in said feature channels of said respective frequency layouts. 

It is preferable that said second sub step include a first step of extracting 
energy values of a texture feature type for said images in said feature channels of the 
corresponding frequency layout for said energy feature type; and a second step of 
1 5 extracting energy deviation values of a texture feature type for said images in said fealure 
channels of the corresponding frequency layout for said energy deviation feature type. 

Also, it is preferable that said third step include a first sub-step of 
constituting texture descriptors of said images with said energy values and energy deviation 
values in a vector form; and a second sub-step of adding the mean and standard deviation 
20 values of said images into each of said texture descriptors of said images. 

More preferably, the second step includes extracting energy values and 
energy deviation values as texture features for said images in said feature channels of said 
frequency layout. 

Still more preferably, the first sub-step includes a step of generating, based 
25 on the HVS, more than one frequency layout for which each frequency layout is used for 
extracting feature values of each feature type; and a step of assigning significance or 
priority to respective channels of said frequency layouts. 

Also, it is preferable that the second sub-step include a step of Radon- 
transforming the inputted images; a step of Fourier-transforming said Radon-transformed 
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image; and a step of extracting feature values from said Fourier-transformed image in said 
respective feature channels of said frequency layout. The step of extracting feature values 
from said Fourier-transformed imasie is of extracting at least energy values or energy 
deviation values from said respective feature channels of said frequency layout. 
S Also, a method of retrievine relevant texture images in a database similar to 

a query image is described. The method includes a first step of generating a frequency 
Jayout by partitioning frequency domain into a set of feature channels for feature extraction 
of an input query image; a second step of extracting a query texture descriptor of said query 
image when said query image is inputted; a third step of reading a texture descriptor from 

10 said database; a fourth step of measuring a distance between said texture descriptor of said 
input texture image and said texture descriptor read from said database; a fifth step of 
measuring distances for said texture descriptor of said input image to all or at least parts of 
the texture descriptors in said database; and a sixth step of ordering the similarity for the 
said texture descriptor to said texture descriptors in said database using said measured 

15 distances. 

It is preferable that when rotation-invariant matching of said image is 
considered, said fifth step include a first sub-step of measuring distances between a texture 
descriptor taken from said database and said query texture descriptor by shifting feature 
values of said query texture descriptor in angular directions into the corresponding 

20 positions where the shifted feature values are supposed to be extracted when said query 
image rotates; a second sub-step of measuring the distances between said texture descriptor 
of said input texture image to said texture descriptor stored in said database for all rotation 
angles; and a third sub-step of determining as said distance the minimum distance between 
said texture descriptor of s;aid input texture image and said texture descriptor stored in said 

25 database for all rotation angles. 

Also, it is preferable that when scale-invariant matching of said image is 
considered, said fifth step include a first sub-step of forming at least one zoom-in image 
and/or zoom-out image from said query image and extracting said query texture descriptors 
of zoom-in and/or zoom-out images of said query image; a second sub-step of measuring 



the distances between said query texture desenptors of zoom-in and/or zoom-out query 
images and said data texture descriptor in said database; and a third sub-step of determining 
as the distance the minimum distance of said distances between said texture descriptor in 
said database and said texture descriptor of said query texture descriptors at different scale 
values. Here, it is preferable thai said query .texture descriptor and said texture descriptor 
in said database include a rotational reference axis, a radial reference point, and mean and 
stand deviation of texture image intensities, respectively. 

It is further preferable that when rotation-invariant of said query texture 
descriptor is considered, said fifth step is of aligning said texture descriptor of said query 
image and said texture descriptor in said database with reference to given rotation angles. 

Also, it is preferable that said rotational reference axes are set to be radial 
axes in which one of an energy, an entropy, and a periodical component is most distributed 
in Fourier transform of said Radon-transformed images. 

' Preferably, when intensity-invariant matching of said query texture 
descriptor is considered, said fifth step is of excluding mean values from said query texture 
descriptor and said texture descriptor in said database and measuring a distance between 

said two texture descriptors. 

More preferably, when scale-invariant matching of said query texture image 
is considered, said fifth step comprises a first sub-step of merging said feature values of the 
adjacent channels in radial directions for said two texture descriptors to be compared or 
shifting feature values of said two texture descriptors into radial directions according to a 
radial reference point; and a second sub-step of measuring a distance between said two 
texture descriptors with feature values merged in adjacent feature channels or with feature 
values shifted into adjacent feature channels. 

Here, said radial reference point is preferably set by determining an arc in 
which energy or entropy or periodical components of said Fourier-transformed image apart 
at the same distance from the origin in said frequency domain are most distributed and 
setting a radius of said determined arc as said radial reference point. 
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When scale-invariant and relation- invariant matching is considered 
simultaneously, said fifth step includes a first sub-step of merging said feature values of the 
adjacent channels in radial directions for said two texture descriptors to be compared or 
shifting feature values of said two texture descriptors into radial directions with reference 
5 to a radial reference point: a second sub-step of shifting feature values of said two texture 
descriptors in angular directions into the corresponding positions where the shifted feature 
, > . . values are supposed to extracted with reference to a rotation point; and a third sub-step of 
measuring a distance between said two texture descriptors with feature values of adjacent 
feature channels merged in radial directions and then shifted in angular directions. 

10 A computer readable recording media recording a program retrieving a data 

image similar to any query image in a computer is described. The program performs the 
following steps: a first Step of generating a frequency layout by partitioning the frequency 
domain into a set or feature channels; a second step of, when images to be stored in a 
database is given, extracting texture feature values of fcaid data image in said respective 

15 feature channels, and then extracting and storing a data texture descriptor of said data 
image by using said extracted texture feature values; a third step of, when said query image 
is inputted, extracting texture feature values of said query image in said respective feature 
channels, and extracting a query texture descriptor of said query image by using said 
extracted texture feature values; a fourth step of matching said data texture descriptor with 

20 said query texture descriptor and measuring a distance between two texture descriptors; and 
a fifth step of determining a similarity between said two images by means of said distance 
between said two texture descriptors. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 The embodiments of the present invention will be explained with reference 

to the accompanying drawings, in which: 

Figure 1 is a flow chart for illustrating a texture description method in a 
frequency domain according to an embodiment of the present invention; 

9 



Figures 2A and 2B are drawings illustrating the general Central Slice 



theorem; 



Figure 3 is a drawing for illustrating a frequency sampling structure in the 
frequency domain using Radon transformation; 

Figure 4 is a drawing for showing a frequency layout used to extracting 
average values in respective frequency channels in the present invention; and 

•~ - Figure 5 is a drawing showing a frequency layout used to extract energy 
deviation values in respective frequency channels in the present invention. 

DETAILED DESCRIPTION OF TJ IE INVENTION 

The above features and advantages of the present invention will be better 
understood from the following description taken in conjunction with the attached drawings. 

Figure 1 shows a flow chart for illustrating a texture description method in a 
frequency domain according to the present invention, using Radon transformation. 

The texture description method is used both in texture information-based 
indexing of the image and in texture information-based retrieval of the image, in which the 
input image is processed to prepare a texture descriptor. When images to be stored in a 
database arc given, the corresponding data texture descriptors are generated and the 
generated texture descriptors are stored in the database. Also, when a query image is 
inputted, a query texture descriptor is generated and compared with the data texture 
descriptors stored in the database to perform retrieval. 

With reference to Figure 1, the texture description method according to the 

present invention will be described as follows. 

First, when any image is inputted (SI 1), the inputted image is Radon- 
transformed at step S12. Here, Radon-transformation means a serial procedure of 
performing a line integral of 2-dimensional (2-D) image or multi -dimensional multimedia 
data along a light axis to obtain 1 -dimensional projection data. That is, an object appears 
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different according to viewing angles, and when viewing the object from all angles, 
profiles of the object can be guessed. The Radon transformation uses this principle. 

The Radon transformation equation of the 2-dimcnsional image is expressed 

as follows. 

s 

p 0 (R)= f LfRB /(^yM u ^ H, E o f(x.yWxct*Q+ysi*Q--s)dxfy EQ. 1 

Mere, f(x.y) is an image in the Cartesian coordinate system, and po(R) is an 
1-D projection obtained by the line integration of the image along a light axis of which the 
10 angle with respect to a positive x- axis is 0and which passes through the origin in the 
Cartesian coordinate system. That is, po(R) is an 1-D projection of the image by Radon 
transformation. 

A function S(x) is a function which becomes 1 when x value is 0. The 2- 
dimensional image has the range of '-co < x, y < oo' in the Cartesian coordinate system and a 
1 5 range of '0 < s < oo, 0 < 0< 7f in a Radon coordinate system. That is, when xcosO+ysinO is 
s, 8(xcosd ±ysin0-s) becomes 1 . 

A set of the first Radon transform functions pd[R) is referred to as 
Signogram, and in next step SI 3, the Signogram is Fourier transformed. As a result of 
Fourier transforming the Signogram, relationships between the Fourier transform of the 
20 Signogram and the Fourier transform of the image in the Cartesian coordinate system is 
expressed as set forth in Equation 2 below. 

Gq(X) = F(XcosQ.XsinO) = F(<o x .<0 y ^ mx =\cosB t t»y^\smQ R Q* 2 

25 Here, G rfZ) is a function to which pd(R) is Fourier transformed. And X is 

yjo; f af y and 0is tan -1 ^/©,). 

Figure 2 shows a Central Slice theorem and is a drawing illustrating a 
relationship between the Signogram and a 1 -dimensional Fourier transform of the 
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Signogram. The Fourier transform of the Signogram is a function value taken by culling 
the Fourier transform function of the 2-dimcnsional image along Ihe 0-axis. 

That is. Ihe image function is Fourier-transformed after Radon transforming 
„, as shown in Figure 2(B), the resulting Fourier transform of the image is represented in 
5 the. Polar coordinate system, and frequency sampling in the Polar coordinate system is 
shown in Figure 3. 

Thus, Figure 3 is a drawing illustrating a frequency sampling structure in the 
frequency domain using Radon transformation. The Fourier transform using the Radon 
transform converts the image signal into the frequency domain in the Polar coordinate 
10 system. This frequency sampling is described such that the density of the frequency 
sampling is high in low frequency regions and becomes lower from low to high frequency 
regions. 

This sampling structure is well suited for the characteristics that infoimation 
of general image texture is gathered in the low-to-mid frequency region, and features 
15 extracted from this frequency sampling structure represent well the characteristics of image 
texture. 

Next, in step S14, the image texture features are extracted in the frequency 
domain of the Polar coordinate system having a frequency sampling structure as shown in 
Figure 3. At that time, a frequency layout of the Polar coordinate system generated in step 
20 S15 is used. The respective partitioned frequency domains are referred to as a feature 
channel. 

The frequency layout is a partition of the frequency domain on the basis of 
the HVS (Human Visual System). That is, the HVS is shown to be insensitive to the high 
frequency components and sensitive to the low frequency components of images and the 
25 frequency layout is designed by using such characteristics. The details thereof will be 
described later. 

The present invention employs respective frequency layouts, that is, energy 
values and energy deviation values of Fourier transform of the image in respective 
channels, as an image texture feature. For this reason, a frequency layout of the Polar 
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coordinate system for extracting the energy values and a frequency layout of the Polar 
coordinate system for extracting the energy deviation values arc separately generated. 

Fiuure 4 is a drawing showing a frequency layout of the Polar coordinate 
system used to extracting the energy values of respective channels on the basis of HVS. 
5 As shown in Figure 4, the frequency domain of the Polar coordinate system 

is partitioned in a radial direction and in an angular direction. The frequency domain is 
partitioned at .intervals of 2 ; (0 < / < log2(N/2)-l) octave in the radial direction ajid 0 is 
partitioned at intervals of 'ISO/dividing resolution' in the angular direction. By this 
partition, a frequency layout of the Polar coordinate system for extracting the energy values 
10 is dense at low frequency regions and sparse at high frequency regions. The respective 
partitioned frequency regions indicate feature channels and the slashed part is a 5-th 
channel. 

From the above description, a primary characteristic of the present invention 
is known, in which the sampling density at low frequency region is high and the sampling 

1 5 density at high frequency region is low due to the Radon transform. When partitioning the 
frequency domain on the basis of HVS, the low frequency region is partitioned densely and 
the high frequency region is partitioned sparsely. That is, the feature values extracted from 
the respective partitioned frequency regions, that is, the respective channels, reflect well 
the global texture features all together. 

20 Figure 5 is a drawing showing a frequency layout used to extract energy 

deviation values on the basis of HVS. 

Unlike the frequency layout of the Polar coordinate system for extracting 
the energy values, the frequency layout of the Polar coordinate system for extracting the 
energy deviation values uniformly partitions the frequency domain in a radial direction. 

25 However, 0is partitioned by 180/P (here, P is a dividing resolution of 0) in the angular 
direction as in the frequency layout of Figure 4. The respective partitioned frequency 
regions constitute feature channels, and the 35th channel is slashed. 

In the present invention, the respective frequency layouts are designed for 
means of the extracted feature values. This provides flexibility, so that the optimal 
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frequency layout is allowed lo provide high retrieval rate of relevant texture images to the 
respective features. 

When the energy values and the energy deviation values are obtained in the 
respective channels, the image texture descriptor describing the image texture from the 
5 feature values, that is, a feature vector, is computed in step SI 6. 

The texture descriptor is expressed in Equation 3 below. 

TD «{ffe.q.. ~.ei-Q.d H 'Q+\' d P'Q+l d r*Q+Q\ ( E Q 3 ) 

10 Here, e, is the energy value of the i-th channel in the frequency layout 

shown in Figure 4 and dj is the energy deviation value of the>th channel in the frequency 
layout shown in Figure 5. Specifically, e 0 represents the energy of a DC channel. P is the 
number of the frequency regions partitioned in the angular direction and Q is the number of 
the frequency regions partitioned in the radial direction, in the frequency domain of the 

15 Polar coordinate system. 

The respective feature values of Equation 3 can be first described according 
to the priority of the channels, and the size of the texture descriptor decreases when 
excluding the feature values of the channels having low significance according to the 
significance of channels. 

20 The energy value c, and the energy deviation value dj are obtained by means 

of Equation 5 and Equation 7, respectively, below. In Equation 4, Pi is obtained by using 
Gg(X) which is the Fourier transform of p e {R), and in Equation 6, <?, is obtained by using 
G e (X) and /?, obtained in Equation 4 below. 



25 



<!> = fzZDj(K^Ma hPj l (hq. 6) 
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As described above, a texture descriptor constituted with. the energy values 
and the energy deviation values of respective feature channels is obtained. 

With respect to all the inputted images, step Stl through step S16 are 
5 repeatedly performed and the respective data texture descriptors arc stored in the database. 

The data texture descriptors stored in the database arc matched with the 
query texture descriptor obtained from the qucry image to be used for retrieval the image 
similar to the query image. 

Hereinafter, the texture-based retrieval method in the Polar coordinate 
1 0 frequency domain will be described. 

In order to retrieve the image similar to the query image, 3 elements are 
considered in the present invention. First, the intensity-invariant matching is considered. 
That is, there are two cases, the one that the images similar in texture are retrieved without 
considering the changes in intensity of image and with considering the intensity changes. 
1 5 Second, rotation-invariant matching is considered. That is, the retrieval in consideration of 
rotation of image and the retrieval without consideration of rotation of image is classified. 
Third, scale-invariant matching is considered. That is, the original image is zoomed 
in/zoomed out to be retrieved in cases of abridgement/enlargement of the image. 

First, the intensity-invariant retrieval method of texture images is explained. 
20 The intensity of an image is represented by means of an energy value e^of the DC channel 
of the texture descriptor (TD) vector. That is, e 0 is large when the image is bright and 
indicates small values when the image is dark. Therefore, in the intensity-invariant 
retrieval, e 0 is excluded from TD vector of the data texture descriptor vector and then the 
TD vector is matched with the query texture descriptor during the similarity matching. 
25 However, when the retrieval is performed in consideration of intensity-invariant matching, 
the TD vector containing e 0 is matched with the query texture descriptor. 

Next, a first embodiment of the retrieval method with invariability in 
rotation is explained. When the image is rotated with respect to the same image, the 
conventional texture-based retrieval method did not retrieve the image as the same image. 

15 



However, in the present invention, by performing matching of the images with invariability 
in rotation of image, the retrieval may be performed without consideration of rotation. The 
rotation-invariant retrieval method is as follows. It is known that a rotated image in the 
time domain results in the rotated Fourier transform of the original image. 

5 t in a state that the data texture descriptors 77),- are stored in the database, the 

query image is processed by means of the texture description method of Figure 1 to obtain 
the query texture descriptor TD qaery . Then, a similarity between any Tt> m and TD^ is 
computed to measure the matching degree. 

The similarity is in inverse proportion to D m obtained by means of 

10 Equation 8 below. 

D m =disUmce(TD m JD qxtery ) <EQ- 8 ) 

A distance between the data texture descriptor and the query texture 
15 descriptor is obtained by comparing the texture descriptor having energy and energy 
deviation values. As explained above, the result is that any image has been rotated and 
then Fourier transformed is equal to the result that the image has been Fourier transformed 
and then rotated in the frequency domain. When two images are compared while rotating 
them in the frequency domain, two similar images can be determined. 
20 Therefore, in the present invention, in comparing the distance between two 

texture descriptors by comparing the texture descriptors, the matching is performed in 
consideration of the possibility of rotation. By that consideration, all the rotated similar 
images can be retrieved. The matching is represented in Equation 9 below. 

25 D% =distance(TD m \ k JD query ) (EQ- 9) 

Here, </> is 180/P, and k is any integer between 1 and P. That is, Equation 9 
is the equation for obtaining the distance between the rotated data texture descriptor and the 
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query texture descriptor, with the data texture descriptor rotated by the angle <f> in the 
frequency domain. 

By applying the distances in respective rotational angle ranges obtained in 
Equation 9 to the following Equation 10, the minimum distance is determined. 

5 

D m =min(Di*j tk€fl _ n (EQ. 10) 

By comparing the data texture descriptor having the query texture descriptor 
with the data texture descriptor rotated by a minute angle and selecting the minimum 

10 distance between two texture descriptors as a distance between two texture descriptors, the 
similar image can be retrieved regardless of rotation of image. On the contrary, when the 
retrieval is performed without considering invariability in rotation of image, the similarity 
is retrieved by means of Equation 8. 

In retrieval in consideration of invariability in rotation of the image, as 

15 described above, e 0 is contained in the texture descriptor vector when the intensity of the 
image is considered, and e 0 is excluded from the texture descriptor vector when the 
intensity of the image is not considered. Thereafter, texture-based retrieval in 
consideration of invariability in rotation is performed. 

Now, a second embodiment of the retrieval method with invariability in 

20 rotation of image is explained. As described above, Fourier transformation of the rotated 
image is equal to the result of rotating the Fourier transform of the non-rotated image in the 
frequency domain. Therefore, in matching the texture descriptors, when the matching is 
performed in consideration of the possibility of rotation, all images having equal texture 
and being rotated can be retrieved. For this performance, in the first embodiment of the 

25 retrieval method with invariability in rotation, the method of matching the data texture 
descriptors with the query texture descriptor is provided, with the data texture descriptor 
rotated by a minute angle. 

On the contrary, in the second embodiment of the present invention, a 
method of adding the rotation information to the texture descriptor is provided. That is, if 
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the image is Radon transformed, a reference angular direction which is most periodical or 
in which energy is most distributed is known. The Polar coordinate frequency layout 
(transformed layout) is generated using the direction as a reference axis, and then the 
texture descriptor of Figure 1 is computed. At that time, the transformed layout is rotated 
5 with respect to the Polar coordinate layout of Figure 5, and the reference axis of the 
transformed layout and the reference axis of the original Polar coordinate frequency layout 
are added to thetcxture descriptor as rotation information. 

When a retrieval is required and the query texture descriptor containing the 
rotation information is provide together with the database storing the data texture 

10 descriptors containing the rotation information, two texture descriptors are matched in the 
rotational angles by using the rotation information of the data texture descriptor and the 
rotation of the query texture descriptor. 

That is, the reference angular directions of two images are matched, and in 
this state the distance between two images is 'obtained by comparing two texture 

15 descriptors. Unlike the first embodiment, the second embodiment has an advantage that 
similarity between two images can be obtained without the procedure of obtaining the 
distance between two texture descriptors by comparing the data texture descriptor with the 
query texture descriptor while the data texture descriptor is rotated. However, because the 
procedure of obtaining and adding the rotation information to the texture descriptor is 

20 added to the step of describing the texture, computing the texture descriptor becomes 
complex. 

Here, the rotation information is represented using the Radon transform of 
the image, in which the reference direction is the direction in which energy is most periodic 
or in which energy is most distributed. However, a method of finding out the reference 
25 axis of rotational direction using the texture information of the image and describing the 
texture by matching the frequency layout with the reference axis, or a texture description 
method using the frequency layout without the reference axis may be employed, and the 
present invention is not limited to those methods. 
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Third, in the texture-based retrieval method of an embodiment according to 
the present invention, as described above, invariability in abridgement/enlargement or 
image is considered and is explained in detail herein. 

When the image is obtained through a varying zoom of a camera, the 
5 obtained image is pjbridged or enlarged according to the zoom magnification of the camera. 
When such effect is analyzed in the frequency domain, the frequency spectrum distribution 
of an image enlarged from-the original image shrinks toward the origin of the frequency 
domain than does the original spectrum. Also, the frequency spectrum distribution of an 
image abridged from the original image spreads out from the origin of the frequency 
1 0 domain than the original spectrum. 

• By Radon transformation of the image, a scale reference is determined with 
reference to the energy of the projection data. When the texture-based retrieval with 
invariability in abridgement/enlargement of image is performed with respect to such an 
image, by adding a feature value of the adjacent channel with reference to the scale 
1 5 reference in a radial direction to be overlapped by one channel, or by finding out a channel 
enlarged/abridged from the origin due to abridgement/enlargement, the similarity is 
computed as in Equation 1 1 below. The added channel is referred to as an merged channel 
or a matching channel and in a word, as a modified channel. 

20 D k = dis tan ce( modified channel featuref*™ .modified channel feature™^) (EQ. 11) 

When the texture descriptor is obtained by finding out a reference point in 
the radial direction by using texture information from the image, normalizing Fourier 
transform of the image with reference to the reference point, and then extracting a feature 
25 value of the normalized Fourier transform, similarity retrieval can be performed using 
Equation 8. 

Here, a radius of the determined arc as follows is set as the reference point 
in the radial direction. The arc is determined in which the energy or entropy or periodical 
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component of the Fourier-transformed image apart at the same distance from the origin in 
the frequency domain is most distributed is determined. 

Another embodiment of the retrieval method with invariability in 
abridgement/enlargement is described. By making one inputted image at least one 
enlarged image or at least one abridged image, the texture descriptor is represented by 
means of respective enlarged/abridged query images. Then, the texture descriptors of the 
respective enlarged/abridged query images are extracted and a distance to the data texture 
descriptor is measured by means of Equation 8 above. The minimum distance of the 
distances between the data descriptor and the data descriptors of the respective 
enlarged/abridged query image is determined as an original distance between the query 
texture descriptor and the data texture descriptor. 

When the retrieval without invariability in abridgement/enlargement of the 
image is performed, the similarity is computed by means of Equation 8. 

When the retrieval with both invariability in abridgement/enlargement and 
invariability in rotation is performed, in the retrieval with invariability in 
abridgement/enlargement of image, adjacent channels are merged and modified, and then 
feature values of the modified channels arc retrieved invariantly in rotation. At that time, 
the similarity retrieval is performed by means of Equations 1 1, 9 and 10. 

The texture descriptor TD vector expressed in Equation 3 enables the 
texture structure information to be inferred from the arranged pattern of feature values of 
the texture descriptor. This can support the functionality of roughly finding out a special 
structure of the texture to browse. Tn order to support the simple browsing, in the present 
invention, the simple structure information of texture is computed using feature values 
extracted from the energy channel as show in Figure 4. Computing the texture structure is 
performed by obtaining entropy of feature values of 30 energy channels, or by computing 
the angular difference or radial difference between two maximum energies in the energy 
channel layout. 

According to the above-described present invention, the image texture can 
be described more accurately and the effective indexing and retrieval is possible by using a 
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method of partitioning the frequency domain in the Polar coordinate system, with a 
frequency layout in the Polar coordinate system suitahle for extracting the respective 
feature values, a method of extracting feature values in respective frequency domains, 
assigning significance and priority to respective frequency channels, a texture indexing 
£ method supporting rotation-, scale-, intensity-invariant retrieval, a texture descriptor 
matching method, and the like. 
— The image texture descriptor extracted by means of the texture description 

method according to the present invention can be used as a useful searching clue in finding 
out an image having a special feature in an aerial photograph on a grand scale, a military 
1 0 radar image, and the like. 

Although preferred embodiments of the present invention have been 
disclosed with reference to the appended drawings, descriptions in the present specification 
are only for illustrative purpose, not for limiting the present invention. 

Also, those who are skilled in the art will appreciate that various 
1 5 modifications, additions and substitutions are possible without departing from the scope of 
the present invention as defined with reference to the accompanying claims. 
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CLAIMS 



A icxture-based retrieval method of a data image similar to a query image in a 
frequency domain, comprising the steps of: 

a first step of extracting and storing a texture descriptor including texture feature 
values comprising energy values and energy variation values and rotation information of 

Images to be stored in a database; 

a second step of extracting a query texture descriptor including texture feature 
values and rotation information of said query image when said query image is input; 

a third step of aligning the rotating angle between said data texture descriptor and 
said query texture descriptor according to said rotation information of said data texture 
descriptor and said query texture descriptor; 

a fourth step of matching said data texture descriptor with said query texture 
descriptor and measuring a distance between said data texture descriptor and said query 
texture descriptor with rotation angles aligned between said data texture descriptor and said 
query texture descriptor; and 

a fifth step of determining a similarity between said data image and said query 

image by means of said distance. 

2. The texture-based retrieval method of a data image similar to a query image in a 
frequency domain according to claim 1 wherein said step of extracting said texture 
descriptor in said first and second steps comprises: 

a first sub-step of generating a frequency layout by partitioning the frequency 
domain into a set of feature channels so as to extract respective feature value; 

a second sub-step of extracting texture feature values of said images in said 
respective divided frequency domains; and 

a third sub-step of generating a texture descriptor of said image in a vector form by 
using said feature values extracted in said respective frequency channels of said frequency 
layout. 
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3. The texture-based retrieval method of a data image similar 10 a query image in a 
frequency domain according to claim 2 wherein said step of extracting said rotation 
infonn«!ion of said images in ^aid first and second steps comprises: 

a first sub-step of finding out a direction in which energy is much distributed in the 
Fourier transform of said inputted image; ( 

a second sub-step of generating a frequency layout by using said direction as a 
reference axis; and — 

a third sub-step of adding said rotation information of said frequency layout to said 
texture descriptor of said image. 

4. The texture-based retrieval method of a data image similar to a query image in a 
frequency domain according to claim 2 wherein said first sub-step in said step of extracting 
said texture descriptor comprises: 

generating at least one frequency layout in consideration of HVS; and 
assigning priority to respective feature channels of said frequency layouts. 

5. The texture-based retrieval method of a data image similar to a query image in a 
frequency domaiin according to claim 2 wherein said second sub-step in said step of 
extracting said texture descriptor comprises: 

Radon-transforming said input image; 
Fourier-transforming said Radon-transformed image; and 

extracting said texture feature values from said Fourier-transformed image with 
respect to said respective frequency layout. 

6. The texture-based retrieval method of a data image similar to a query image in a 
frequency domain according to claim 5 wherein said step of extracting texture feature 
values from said Fourier-transformed image comprises extracting at least one of energy 
values and energy deviation values in said respective feature channels. 
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7 . A computer readable recording media recording a program retrieving a data nnage 
similar .0 a query image in a comparer, the program performing steps of: 

a firs, step of generaring a frequency layout by pantonine a frequency domam mto 

a set of feature channels; 
5 a second, step of generaring and storing a data texture descriptor by extract,,,, 

tcxtur. feature values eomnristng energy vah.es and energy deviation values of satd feature 
chtuSteis and rotation informarion of said da,a image from said respective feature channels 
when an imaae 10 be stored in a database is given; 

a third step of generating a query texture descriptor by extracting texture feature 
,0 values and the rotation information of said query image from said respective feature 
channels when said query image is input; 

a fourth step of aligning Ore rotating angles between said data texture descriptor and 
M query texture descriptor by using said rotation information of said data texture 
descriptor and said rotation information of said query texture descriptor; 
, 5 a fifth step of matching said data texture descriptor with said query texture 

descriptor and measuring a distance between said data texture descriptor and said query 
texture descriptor with said rotating angles aligned betweea data texture descriptor and satd 

query texture descriptor; and 

a sixth step of determining a similarity between said data image and sa.d query 

20 image by means of said distance. 
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